The SDSC Storage Resource
نویسندگان
چکیده
This paper describes the architecture of the SDSC Storage Resource Broker (SRB). The SRB is middleware that provides applications a uniform API to access heterogeneous distributed storage resources including, lesys-tems, database systems, and archival storage systems. The SRB utilizes a metadata catalog service, MCAT, to provide a \collection"-oriented view of data. Thus, data items that belong to a single collection may, in fact, be stored on heterogeneous storage systems. The SRB infrastructure is being used to support digital library projects at SDSC. This paper describes the architecture and various features of the SDSC SRB.
منابع مشابه
The Grid Adventures: Sdsc's Storage Resource Broker and Web Services in Digital Library Applications
The data handling infrastructure being developed at the San Diego Supercomputer Center, includes a range of approaches and technologies for managing data, information and knowledge, specifically: (1) self-instantiating and self-validating persistent archives; (2) data handling system providing ubiquitous access to data resources stored in a variety of systems, epitomized in the development of S...
متن کاملMass Storage Management and the Grid
The University of Edinburgh has a significant interest in mass storage systems as it is one of the core groups tasked with the roll out of storage software for the UK’s particle physics grid, GridPP. We present the results of a development project to provide software interfaces between the SDSC Storage Resource Broker, the EU DataGrid and the Storage Resource Manager. This project was undertake...
متن کاملRecovery of a Digital Image Collection Through the SDSC/UMD/NARA Prototype Persistent Archive
The San Diego Supercomputer Center (SDSC), the University of Maryland, and the National Archives and Records Administration (NARA) are collaborating on building a pilot persistent archive using and extending data grid and digital library technologies. The current prototype consists of node servers at SDSC, University of Maryland, and NARA, connected through the Storage Request Broker (SRB) data...
متن کاملArchiving, Indexing and Accessing Web Materials: Solutions for large amounts of data
The archiving of Internet materials presents two major challenges: the dynamic nature of the content and the massive number of individual web pages. These two characteristics impact the choice of methods for storing, indexing and providing fast access to archives of materials retrieved from periodic web crawling activities. At the San Diego Supercomputer Center, we have applied two different te...
متن کاملUtilizing Heterogeneous Data Sources in Computational Grid Workflows
Besides computation intensive tasks, the Grid also facilitates sharing and processing very large databases and file systems that are distributed over multiple resources and administrative domains. Although accessing data in the Grid is supported by various lower level tools, end-users find it difficult to utilise these solutions directly. High level environments, such as Grid portal and workflo...
متن کامل